Understanding COVID-19 testing behaviour in England through a sociodemographic lens (preprint)

BackgroundUnderstanding underlying mechanisms of heterogeneity in test-seeking and reporting behaviour can help to protect the vulnerable and guide equity-driven interventions. Using COVID-19 testing data for England and data from community prevalence surveillance surveys (REACT-1 and ONS-CIS) from October 2020 to March 2022, we investigated the relationship between sociodemographic factors and testing behaviours in England. MethodsWe used mass testing data for lateral flow device (LFD; data for 290 million tests performed and reported) and polymerase chain reaction (PCR) (data for 107 million tests performed and returned from the laboratory) tests made available for the general public, provided by date, self-reported age and ethnicity at lower tier local authority (LTLA) level. Using a mechanistic causal model to debias the PCR testing data, we obtained estimates of weekly SARS-CoV-2 prevalence by self-reported ethnic groups and age groups for LTLAs in England. This approach to debiasing the PCR (or LFD) testing data also estimated a testing bias parameter defined as the odds of testing in infected versus not infected individuals, which would be close to zero if the likelihood of test seeking (or seeking and reporting) was the same regardless of infection status. Using confirmatory PCR data, we estimated false positivity rates, sensitivity, specificity, and the rate of decline in detection probability by PCR by sociodemographic groups. We also estimated the daily incidence allowing us to determine the fraction of cases captured by the testing programme. FindingsFrom March 2021 onwards, individuals in the most deprived regions reported approximately half as many LFD tests per-capita than those in the least deprived areas (Median ratio [Inter quartile range, IQR]: 0{middle dot}50 [0{middle dot}44, 0{middle dot}54]). During October 2020 - June 2021, PCR testing patterns were in the opposite direction (Median ratio [IQR]: 1{middle dot}8 [1{middle dot}7, 1{middle dot}9]). Infection prevalences in Asian or Asian British communities were considerably higher than those of other ethnic groups during the Alpha and Omicron BA.1 waves. Our estimates indicate that the England COVID-19 testing program detected 26% - 40% of all cases (including asymptomatic cases) over the study period with no consistent differences by deprivation levels or ethnic groups. PCR testing biases were generally higher than for LFDs, which was in line with the general policy of symptomatic and asymptomatic use of these tests. During the invasion phases of the Delta and Omicron variants of concern, the PCR testing bias in the most deprived populations was roughly double (ratio: 2{middle dot}2 and 2{middle dot}7 respectively) that in the least. We also determined that ethnic minorities and older individuals were less likely to use confirmatory PCR tests through most of the pandemic and that there was possibly a longer delay in reporting a positive LFD test in the Black populations. InterpretationDifferences in testing behaviours across sociodemographic groups may be reflective of the relatively higher costs of self-isolation to vulnerable populations, differences in test accessibility, digital literacy, and differing perception about the utility of tests and risks posed by infection. Our work shows how mass testing data can be used in conjunction with surveillance surveys to identify gaps in the uptake of public health interventions at fine scale levels and by sociodemographic groups. It provides a framework for monitoring local interventions and yields valuable lessons for policy makers in ensuring an equitable response to future pandemics. FundingUK Health Security Agency.

Statistical Design and Analysis for Robust Machine Learning: A Case Study from COVID-19 (preprint)

Since early in the coronavirus disease 2019 (COVID-19) pandemic, there has been interest in using artificial intelligence methods to predict COVID-19 infection status based on vocal audio signals, for example cough recordings. However, existing studies have limitations in terms of data collection and of the assessment of the performances of the proposed predictive models. This paper rigorously assesses state-of-the-art machine learning techniques used to predict COVID-19 infection status based on vocal audio signals, using a dataset collected by the UK Health Security Agency. This dataset includes acoustic recordings and extensive study participant meta-data. We provide guidelines on testing the performance of methods to classify COVID-19 infection status based on acoustic features and we discuss how these can be extended more generally to the development and assessment of predictive methods based on public health datasets.

Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers (preprint)

Recent work has reported that AI classifiers trained on audio recordings can accurately predict severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection status. Here, we undertake a large scale study of audio-based deep learning classifiers, as part of the UK governments pandemic response. We collect and analyse a dataset of audio recordings from 67,842 individuals with linked metadata, including reverse transcription polymerase chain reaction (PCR) test outcomes, of whom 23,514 tested positive for SARS CoV 2. Subjects were recruited via the UK governments National Health Service Test-and-Trace programme and the REal-time Assessment of Community Transmission (REACT) randomised surveillance survey. In an unadjusted analysis of our dataset AI classifiers predict SARS-CoV-2 infection status with high accuracy (Receiver Operating Characteristic Area Under the Curve (ROCAUC) 0.846 [0.838, 0.854]) consistent with the findings of previous studies. However, after matching on measured confounders, such as age, gender, and self reported symptoms, our classifiers performance is much weaker (ROC-AUC 0.619 [0.594, 0.644]). Upon quantifying the utility of audio based classifiers in practical settings, we find them to be outperformed by simple predictive scores based on user reported symptoms.

A large-scale and PCR-referenced vocal audio dataset for COVID-19 (preprint)

The UK COVID-19 Vocal Audio Dataset is designed for the training and evaluation of machine learning models that classify SARS-CoV-2 infection status or associated respiratory symptoms using vocal audio. The UK Health Security Agency recruited voluntary participants through the national Test and Trace programme and the REACT-1 survey in England from March 2021 to March 2022, during dominant transmission of the Alpha and Delta SARS-CoV-2 variants and some Omicron variant sublineages. Audio recordings of volitional coughs, exhalations, and speech were collected in the 'Speak up to help beat coronavirus' digital survey alongside demographic, self-reported symptom and respiratory condition data, and linked to SARS-CoV-2 test results. The UK COVID-19 Vocal Audio Dataset represents the largest collection of SARS-CoV-2 PCR-referenced audio recordings to date. PCR results were linked to 70,794 of 72,999 participants and 24,155 of 25,776 positive cases. Respiratory symptoms were reported by 45.62% of participants. This dataset has additional potential uses for bioacoustics research, with 11.30% participants reporting asthma, and 27.20% with linked influenza PCR test results.

A spatio-temporal framework for modelling wastewater concentration during the COVID-19 pandemic (preprint)

The potential utility of wastewater-based epidemiology as an early warning tool has been explored widely across the globe during the current COVID-19 pandemic. Methods to detect the presence of SARS-CoV-2 RNA in wastewater were developed early in the pandemic, and extensive work has been conducted to evaluate the relationship between viral concentration and COVID-19 case numbers at the catchment areas of sewage treatment works (STWs) over time. However, no attempt has been made to develop a model that predicts wastewater concentration at fine spatio-temporal resolutions covering an entire country, a necessary step towards using wastewater monitoring for the early detection of local outbreaks. We consider weekly averages of flow-normalised viral concentration, reported as the number of SARS-CoV-2 N1 gene copies per litre (gc/L) of wastewater available at 303 STWs over the period between 1 June 2021 and 30 March 2022. We specify a spatially continuous statistical model that quantifies the relationship between weekly viral concentration and a collection of covariates covering socio-demographics, land cover and virus-associated genomic characteristics at STW catchment areas while accounting for spatial and temporal correlation. We evaluate the models predictive performance at the catchment level through 10-fold cross-validation. We predict the weekly viral concentration at the population-weighted centroid of the 32,844 lower super output areas (LSOAs) in England, then aggregate these LSOA predictions to the Lower Tier Local Authority level (LTLA), a geography that is more relevant to public health policy-making. We also use the model outputs to quantify the probability of local changes of direction (increases or decreases) in viral concentration over short periods (e.g. two consecutive weeks). The proposed statistical framework is able to predict SARS-CoV-2 viral concentration in wastewater at high spatio-temporal resolution across England. Additionally, the probabilistic quantification of local changes can be used as an early warning tool for public health surveillance.

Time varying association between deprivation, ethnicity and SARS-CoV-2 infections in England: a space-time study (preprint)

Background: Ethnically diverse and socio-economically deprived communities have been differentially affected by the COVID-19 pandemic in the UK. Method: Using a multilevel regression model we assess the time-varying association between SARS-CoV-2 infections and areal level deprivation and ethnicity. We separately consider weekly test positivity rate and estimated unbiased prevalence at the Lower Tier Local Authority (LTLA) level, adjusting for confounders and spatio-temporal correlation structure. Findings: Comparing the least deprived and predominantly White areas with most deprived and predominantly non-White areas over the whole study period, the weekly positivity rate increases by 13% from 2.97% to 3.35%. Similarly, prevalence increases by 10% from 0.37% to 0.41%. Deprivation has a stronger effect until October 2020, while the effect of ethnicity becomes more pronounced at the peak of the second wave and then again in May-June 2021. In the second wave of the pandemic, LTLAs with large South Asian populations were the most affected, whereas areas with large Black populations did not show increased values for either outcome during the entire period under analysis. Interpretation: IMD and BAME% are both associated with an increased COVID-19 burden in terms of disease spread and monitoring, and the strength of association varies over the course of the pandemic. The consistency of results across the two outcomes suggests that deprivation and ethnicity have a differential impact on disease exposure or susceptibility rather than testing access and habits.

Interoperability of statistical models in pandemic preparedness: principles and reality (preprint)

We present "interoperability" as a guiding framework for statistical modelling to assist policy makers asking multiple questions using diverse datasets in the face of an evolving pandemic response. Interoperability provides an important set of principles for future pandemic preparedness, through the joint design and deployment of adaptable systems of statistical models for disease surveillance using probabilistic reasoning. We illustrate this through case studies for inferring spatial-temporal coronavirus disease 2019 (COVID-19) prevalence and reproduction numbers in England.

Local prevalence of transmissible SARS-CoV-2 infection : an integrative causal model for debiasing fine-scale targeted testing data (preprint)

Targeted surveillance testing schemes for SARS-CoV-2 focus on certain subsets of the population, such as individuals experiencing one or more of a prescribed list of symptoms. These schemes have routinely been used to monitor the spread of SARS-CoV-2 in countries across the world. The number of positive tests in a given region can provide local insights into important epidemiological parameters, such as prevalence and effective reproduction number. Moreover, targeted testing data has been used inform the deployment of localised non-pharmaceutical interventions. However, surveillance schemes typically suffer from ascertainment bias; the individuals who are tested are not necessarily representative of the wider population of interest. Here, we show that data from randomised testing schemes, such as the REACT study in the UK, can be used to debias fine-scale targeted testing data in order to provide accurate localised estimates of the number of infectious individuals. We develop a novel, integrative causal framework that explicitly models the process underlying the selection of individuals for targeted testing. The output from our model can readily be incorporated into longitudinal analyses to provide local estimates of the reproduction number. We apply our model to characterise the size of the infectious population in England between June 2020 and January 2021. Our local estimates of the effective reproduction number are predictive of future changes in positive case numbers. We also capture local increases in both prevalence and effective reproductive number in the South East from November 2020 to December 2020, reflecting the spread of the Kent variant. Our results illustrate the complementary roles of randomised and targeted testing schemes. Preparations for future epidemics should ensure the rapid deployment of both types of schemes to accurately monitor the spread of emerging and ongoing infectious diseases.

Bayesian imputation of COVID-19 positive test counts for nowcasting under reporting lag (preprint)

Obtaining up to date information on the number of UK COVID-19 regional infections is hampered by the reporting lag in positive test results for people with COVID-19 symptoms. In the UK, for "Pillar 2" swab tests for those showing symptoms, it can take up to five days for results to be collated. We make use of the stability of the under reporting process over time to motivate a statistical temporal model that infers the final total count given the partial count information as it arrives. We adopt a Bayesian approach that provides for subjective priors on parameters and a hierarchical structure for an underlying latent intensity process for the infection counts. This results in a smoothed time-series representation now-casting the expected number of daily counts of positive tests with uncertainty bands that can be used to aid decision making. Inference is performed using sequential Monte Carlo.